Posts tagged “{{ tag }}”

An Offline Metric for the Debiasedness of Click Models

Click models aim to identify and extract biases in search data, but we do not evaluate whether they actually do so. We propose a metric based on relevance annotations that measures the debiasedness of click models, and consequently their usefulness in learning-to-rank from implicit feedback.

Offline Evaluation for Reinforcement Learning-based Recommendation: A Critical Issue and Some Alternatives

We discussed offline evaluation for RL-based recommender systems and noted that the most common evaluation protocol, i.e., next-item prediction, is unsuited to such approaches.

Articles Tagged: "Offline evaluation"

An Offline Metric for the Debiasedness of Click Models

Offline Evaluation for Reinforcement Learning-based Recommendation: A Critical Issue and Some Alternatives